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@ Character and Image processing apparatus. 

® A character and Image processing apparatus com- 
IDflses a scanning section (9) for photoelectrically convert- 
ing data on a sheet (1) in >yhlch character data (2) and image 
data (3) are mixedly arranged in a free format; an image 
buffer (10) for storing the photoelectrically converted data- 
a scanning control circuit (11) for scanning the stored data 
In the image buffer (10) to detect control marks (4, 5, 6, 7, 
6) and for determining a character read mode, an image 
data output mode or a skip mode according to the control 
mark; a character recognizing circuit (12) for recognizing 
characters from the Image buffer (10) when the scanning 
control circuit (11) determines the control marks (4, 5. 6, 7. 
8) as the character read mode; a data compression circuit 
(13) for compressing the Image data from the image buffer 
(10) when the scanning control circuit (11) determines the 
control marks (5. 7. 8) as the Image data output mode- and 
a data editing circuit (14) for discrimlnately editing the 
character data and the image data. 
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Character and image 
processing apparatus 

This invention relates to a character and image 
processing apparatus having combined functions o£ an 
5 optical character reader (hereinafter referred to as 

OCR) and a facsimile (hereinafter referred to as FAX) • 

Recently, a character and image processing 
apparatus having combined functions of the OCR and 
the FAX has been developed, which recognizes character 
10 data and image data on a sheet to provide coded 

character data and non-coded image data (except for 
coding for data compression) to a host computer, for 
example • 

However, in a prior-art character and image 
15 processing system, positions of character data to 
be read out and image data to be scanned on a slip 
should be prestored in the apparatus as format control 
data. This system is suitable for such applications in 
which a large quantity of sheets having the same formats 
20 are processed, but is not suitable for a text entry 

in which sheets having different formats are processed. 

An object of the present invention is to provide 
a character and image processing apparatus in which 
a character-coded data output area and an image data 
25 output area can be arbitrarily and directly specified 
on a document (including sheets) thereby enabling 
the processing of a document having a free format. 
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According to the present invention , the following 
advantages can be achieved. 

(1) Data of a sheet in which characters and 
figures are mixedly arranged in a free-format can be 

5 input to an external device such as a host computer. 

(2) The vertical and horizontal data areas to be 
input can be arbitrarily specified on a sheet by the 
control marks. 

(3) The marking of the control mark can be facili- 
10 tated. When a pencil is used for the marking, the mark 

can be erased easily. 

This invention can be more fully understood from 
the following detailed description when taken in con- 
junction with the accompanying drawings, in which: 
15 other objects and features of the present invention 

will be apparent from the following description taken in 
connection with the accompanying drawings in which: 

Fig. 1 is a schematic view showing an example of a 
sheet 1 to be read by the apparatus of this invention; 
20 Fig. 2 is a block diagram showing an CTibodiment of 

the invention? 

Fig. 3 is a block diagram showing circuits between 
the scanning control circuit and the image buffer; 

Fig. 4 is a flow chart showing the operation of 
25 writing data into the image buffer; 

Fig. 5 is a conceptional view showing the function of 
a data editing circuit shown in Fig. 2; 

Fig. 6 is a detailed block diagram of the data 
editing circuit; 
30 Figs. 7A through 7D are schematic views showing the. 

operation of the scanning control circuit; 

Fig. 8 is a schematic view showing another example 
of a sheet 1; 

Fig. 9 is a schematic view of a sheet showing 
35 modifications of vertical and horizontal bars; 

Figs. lOA arid lOB are schematic views showing 
modifications of entries of vertical and horizontal 
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bars; 

Figs* 11^ through IID aire schematic views showing 
detections of the control mark shown in Fig. lOA; and 

Figs* 12A. through 12H are schematic views of 
modifications of area designations wherein Fig. 12A 
shows the combination of a character read mode^ an image 
scanning mode and a skip mode. Fig. 12B shows the com- 
bi ation of two different modes and Figs. 12C through 
12:; Bhow various examples representing combinations 
of the two modes in the multiplexed designations in 
Fig. 12A. 

Now an embodiment of the present invention will 
be described • 

Fig. 1 shows an example of a document 1 to be read 
by the apparatus of the invention. The document 1 has 
lines of characters 2 and figures 3. Vertical bars 
(hereinafter referred to as VB) 4, 5, 6 as control marks 
are drawn vertically in blank areas at the left the side 
of the sheet. Positions and the number of these VBs 
specify areas and processing modes (character read mode, 
image scanning mode and skip mode which are described 
later), respectively. When no VB is marked in the blank 
area at the left side of the document, the right side 
area thereof is specified as a character read area RE. 
When a single VB is marked such as VB 4, the right side 
area corresponding to the VB is specified as non-read 
area NE. Similarly, the double VBs such as VB 5 specify 
an image output area IE. The control mark of triple VBs 
such as VB 6 completes the processing. In case of the 
image scanning mode, the range of an image area to be 
scanned in a horizontal direction is determined by hori- 
zontal bars (hereinafter referred to as HB) 7, 8 as 
control marks one of which is drawn in a horizontal right 
direction from the top of the double VBs 5 to facilitate 
the pursuit. That is, when the double VBs 5 and no HBs 
are marked, the corresponding whole area at the right 
side of the sheet is specified as the image output area. 
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When the double VBs 5 and single HB are marked , the area 
corresponding to the area beneath the HB is specified as 
the image output area. Further, when double VBs and 
double HBs are marked (the left end of the HB 7 is 
connected to the upper end of the VB), such as HBs 7 
and 8, the area beneath the HB 8 is specified as the 
image output area IE. 

Fig. 2 is a block diagram showing an embodiment of 
the present invention. A scanning section 9 performs 
main-scanning and sub-scanning of the sheet in hori- 
zontal and vertical directions, respectively. The output 
of the scanning section 9 is coupled to an image buffer 
10 which temporarily stores scanned pattern data from 
the scanning section 9, A scanning control circuit 11 
controls . the image buffer 10 to store the scanned pattern 
data and scans the stored pattern data to detect a con- 
trol mark. According to the control mark, the scanning 
control circuit 11 discriminates a character read mode, 
an image input mode or a non-read mode and performs 
processing corresponding to a selected mode. The output 
of the image buffer 10 is coupled to respective inputs 
of a character recognition circuit 12 and a data 
compression circuit 13. Switching control signals from 
the scanning control circuit 11 are also applied to the 
character recognition circuit 12 and to the data 
compression circuit 13. The switching control signals 
are used for distributing data from the image buffer 10 
to the character recognition circuit 12 or to the data . 
compression circuit 13. The character recognition 
circuit 12 recognizes character pattern dat a fr om the 
image buffer 10 under the control of the scanning 
control circuit 11. The detailed description of the 
construction and the operation of the character rec- 
ognition circuit 12 is referred to in, for example 
USP 3,688,267. The data compression circuit 13 
compresses the scanning pattern data from the image 
buffer 10 under the control of the scanning control 
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circuit 11. Both outputs of the character recognition 
circuit 12 and of the data compression circuit 13 are 
coupled to a data editing circuit 14 which edits data 
from the character recognition circuit 12 or from the 
data compression circuit 13 in a predetermined data 
format. The edited data from the data editing circuit 
14 is output to an external device such as a host 
computer through an output interface 15 • 

Fig. 3 is a block diagram showing circuits 
between the scanning control circuit 11 and the image 
buffer 10. Outputs of the scanning control circuit 11 
are connected to a write control circuit 21 and a read 
control circuit 22^ respectively. When writing the 
scanned data into the image buffer 10, the scanning 
control circuit 11 supplies write control signals to 
the write control circuit and when reading the data from 
the image buffer 10, the circuit 11 supplies read con- 
trol signals to the read control circuit 22, The outputs 
of the write control circuit 21 and the read control 
circuit 22 are connected to ah X-counter 24 and a 
Y-counter 25 respectively through a selector 23. The 
X-counter 24 is cleared before starting the main- 
scanning and is incremented during the main-iscanning . 
The contents of the X-counter 24 and the Y-counter 25 
represent the X and Y coordinates on the sheet, 
respectively; Those contents of the counters 24, 25 are 
supplied to the image buffer 10 as an image buffer 
address. The Y coordinate may be the modulus value of 
2^ (n; integer). Furthermore, the output from the X- 
counter 24 is supplied to an H-mask counter 26. Further, 
the output signal from the scanning section 9 is supplied 
to the H-mask counter 26 through an OR gate 27 as well 
as to a V-mask counter 29. The output from the H-mask 
counter 26 is latched by a flip-flop 28, and then, 
through the OR gate, fed back to the counter 26. The 
V-Tiiask counter 29 is cleared immediately before starting 
the main-scanning and counts the number of logical "1" 
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bits during the main-scanning. The logical "1" bit 
and logical "0" bit represent the exsistence and non- 
exsistence of a picture element, respectively. The 
contents of the counter 29 is read into the panning 
control circuit 11 when the main-scanning is completed. 
The H-masK counter 26 is used for making projections 
Of the pattern stored in the image buffer in the sub- 
scanning direction, thereby detecting characters. 

The operation of writing data into the xmage buffer 
10 is as follows. First, in step 31 of Fig. 4 the 
scanning control circuit 11 waits for the end txmxng 
of a main .can. This step is executed for achieving 
initial timing of the apparatus. Xf it is --P^^^^^; 
step 32, the write control circuit 21 clears the H-mask 
counter 26 and turns on the image buffer (IB) write mask, 
in step 33, the write control circuit 21 waits for the 
end timing of a main scan.' At the end of timing, 
write control circuit 21 supplies a pulse to a stepping 
motor (not shown) arid increments the Jj;^ 
step 35, the write control circuit 21 reads the V-mask 
counter 29 and detects the line by a line projection 
Further, in step 36 when the write control circuit 21 
determines that the write operation should be continued, 
the control is returned to step 33 to repeat steps 33 

''''''^''on other hand, when the write operation should 

not be continued, the circuit 21 turns off the image- 
buffer write-mask. That is, when the line i-/-^-^^ 
or when the amount of continuous line projection to be 
written into the image buffer reaches a predetermined 
value, the write operation is interrupted. 

The operation of reading data from the xmage buffer. 
10 is as follows. The reading operation is performed by 
setting addresses to the X-counter 24 and ^"^ounters 25. 
The scanning for the image buffer 10 can be performed by 
setting a start point (X, Y) and incrementing X or Y. 
in case of character detection, characters are 
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Stored in the image buffer and the vertical and hori- 
zontal projections are computed so that positions of 
characters can be detected* 

The data editing circuit 14 edits one page data 
including character data and image data in the image 
buffer 10 to one -line data format and a unit image data 
format as shown in Fig. 5. That is r control codes are 
attached to the one-line data and a unit image data. 
These control codes are for discriminating the character 
data area and the image data area. In the figure, SOL 
stands for start of line, CR stands for carriage return, 
LF stands for line feed and EOL stands for end of line. 
SOL, CR and LF codes are included in ASCII code and EOL 
code is the standard code defined by CCITT. 

Fig. 6 shows a detailed block diagram of the 
data editing circuit 14. The data editing circuit 
14 includes a control circuit 51 which comprises a 
microprocessor, for example an 8-bit microprocessor 
Intel 8085, Intel Corp. U.S.A. The character data 
from the character recognition circuit 12 or the image 
data from the data compression circuit 13 are stored 
into the memory 52 through the multiplexer 53 under 
the control of the select signal from the control 
circuit 51 in accordance with the address from the 
address counter 54 connected to the control circuit 51. 

Now the operation of the above embodiment will be 
described. First, the pattern scanned by the scanning 
section 9 is stored in the image buffer 10. The scanning 
section 9 main-scans and sub-scans in a horizontal 
direction and in a vertical direction to a line, re- 
spectively. The pattern stored in the image buffer 10 
is scanned by the scanning control circuit 11 to detect 
the control mark (VB). When the scanning control circuit 
11 determines the pattern as a character-read area, 
detections of characters of a line and number of lines 
are performed. The character recognition circuit 12 
recognizes the pattern and produces the corresponding 

) 
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character codes . 

On the other hand, when the scanning control circuit 

11 determines the pattern as an image output area, the 
circuit detects HB to determine the image area. The 
scanned pattern of the determined image area are trans- 
ferred from the image buffer 10 to the data compression 
circuit 13. The data compression circuit 13 converts the 
pattern to one-dimensional Modified Hoffman (MH) codes to 
data-compress the pattern. The detailed description of 
the MH conversion is well known to any person skilled in 
the art to which it pertains and therefore it is omitted. 
The processed data from the character recognition circuit 

12 or the data compression circuit 13 are transferred to 
the data editing circuit 14. The data editing circuit 14 
edits the received data into a predetermined format to 
provide an external device such as a host computer 
through the output interface 15. Furthermore, when the 
scanning control circuit 11 determines the pattern as a 
non-read area or determines that the processing for the 
pattern within the image buffer is completed, the circuit 
11 controls the scanning section 9 to re-start the scann- 
ing and to supply the next scanned data to the image 
buffer 10. Then the circuit 11 continues the same pro- 
cessing as described above. When the scanning control 
circuit 11 detects the trailing edge of the sheet or a 
sheet end mark VB 6 positioned at the left side of the 
sheet, the circuit 11 completes the read operation for 
the sheet and forwards to the next-sheet read operation. 

Now an operation for detecting the VB and the HB as 
control marks by the scanning control circuit 11 will be 
described referring Figs.. 7A through 7D. Fig. 7A shows 
patterns to be scanned including VB 5, and HBs 7 and 8. 
(1) Detection of upper position of the control marks 

The detection of the upper position is performed 
by a predetermined-length of X directional scanning from 
top to bottom at left side of the sheet. When a pattern 
exists at right side of the sheet, while no control mark 
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exists, the scanning control circuit 11 recognizes the 
corresponding, area as character read area and detects 
characters of one line and number p£ lines. 

(2) Detection of control mark in a horizontal position 
{ X-coordinates ) 

As shown in Fig. 78, starting from the upper 
position of the control mark 7, a constant-length of 
Y directional scanning is continuously performed in a 
X-direction by the scanning control circuit 11. The 
scanning control circuit 11 counts the logical "1" bits 
for each scanning to make a histogram. Therefore, the 
respective left-end and right-end positions of the first 
VB from the left side of the sheet are obtained. By 
continuing the scanning, the presence and positions or 
absence of the second and third VBs are obtained. 

(3) Pursuit of control mark 

As shown in Fig. 7C, a scanning for the pursuit 
is performed at a plurality of positions in a 
Y-direction starting from the center position between 
the left-end and right-end of the left-most vertical 
bar of the sheet. The scanning is continued until 
the logical "0" bit appears. The longest of the pursuit 
scans is adopted. Then, from both positions equally- 
distanced from the end of the adopted scan at a 
predetermined level, the scanning control circuit 11 
restarts the pursuit in the same manner. Then, the 
longest scan is adopted again. The above operations 
are repeated until the pursuit cannot be continued. 
When the pursuit cannot be continued, the position 
of the final scan can be determined as the bottom 
of the control mask. When the pursuit position in 
a Y-direction reaches the final write position in the 
image buffer 10, the scanning control circuit 11 
interrupts the pursuit and stores the coordinates of the 
position in a predetermined storage area thereof. 

The character and image processing is performed 
in accordance with the number of lines and positions 
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of the control mark described above. When, a single VB 
is detected such as VB 4, data at the light side of the 
sheet corresponding to the VB are not processed. 
Then, next processing is continued from the bottom of 
the VB. Furthermore r when the triple VB, or a trailing 
edge of the sheet mark is detected, the scanning control 
circuit 11 sends the corresponding sheet-end mark data 
to the data editing circuit 14 to perform the sheet-end 
processing. 

When the scanning control circuit 11 detects the 
double VB such as VB 5, the image output mode is set. 
Then, the scanning control circuit 11 further performs 
the following processings; 

(4) Detection of horizontal bar (HB) 

Pursuit is performed in an X-direction near the top 
of the detected VB to detect the HB connected thereto. 

(5) Detection of second HB . 

As shown in Pig. 7D, a raster-scan is performed 
in a left direction from the right end of the first HB 7 
to detect the second HB 8. When the second HB 8 is 
detected, the pursuit ,is performed in a left-direction 
to detect the left— end position of the HB 8, The 
scanning control circuit 11 determines the image output 
area IE from the positions in X and Y directions 
obtained from the above processing steps (4) and (5) f 
and then performs the raster-scan of the area IE in the 
X-direction to transfer the raster-scanned data to the 
data compression circuit 13. 

When the VB already reaches to the final write 
position of a Y direction in the image buffer 10, the 
image data stored in the image buffer 10 are output to 
the data compression circuit 13 and then the remaining ; 
image data is stored. Therefore, the scanning control 
circuit 11 re-starts the pursuit from the X and Y coor- 
dinates of the pursuit-interrupted point stored in the 
image buffer 10. 

In the embodiment described above, a vertical bar 
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is used as a control mark. However / as the embodiment 
shown in Fig. 8, the scanning control circuit 11 may 
alternatively switch the character-read mode and the 
image-output mode in accordance with the hand -writ ten 
5 or printed timing mark 16 • 

In the embodiment in Pig. 8r upon detecting the 
upper edge of the sheet, the scanning control circuit 11 
sets the mode to a character-read mode. Then, the cir- 
cuit switches the mode to the image-output mode upon 

10 detecting the first timing mark 16. In this manner, 

each time the circuit 11 detects the timing mark 16, it 
alternatively switches the mode. By combining the func- 
tions of the skip by the single bar and the image output 
by the double horizontal bars, the same effect can be 

15 achieved as the first embodiment. 

In the above embodiment a single VB is used for 
representing the skip area. However, the single bar may 
represent the character-read area and the single HB may 
represent the skip area. 

20 Furthermore, when characters and images are 

positioned in a same line, inputs of characters only is 
impossible. Fig. 9 shows a modification of VB and HB. 
In the modification, the VB 61 and the HB 62 represent a 
character-read area and a skip area, respectively. 

25 Therefore, it is possible to input only characters as 
the image output area is skipped. The HB 7 is not 
always necessarily connected to the VB 5 but may be 
separated from the VB5 as shown in Fig. lOA. 

The detection of the VB 63 and HB 64 shown in 

30 Fig. lOA can be performed in a same manner as described 
in Figs. 7A through 7D. Pig. IIA shows the scanned 
VB 65 and HBi 66 stored in the image buffer 10. The 
VB 65 can be detected by performing the pursuit of the 
image buffer 10 from left to right as shown in Fig. IIB. 

35 Further, as shown in Fig. IIC, the pursuit of the VBs 65 
and 66 is performed to determine the number of VBs 65 
and 66. On the other hand, to detect the HB 67, the 
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pursuit is performed at near the top of the VB 66. The 
pursuit is continued until a predetermined length of a 
logical "1" bit string is found. To detect the HB 67, 
the same pursuit as the VB 65 is performed from the 
5 leftiaost logical "1" bit block. Further, the 

deteinnination of the number of HBs may be performed in 
a same manner as that of the VBs. As for the detection 
of HB, width of the bar is also detected. The width 
detection is performed by scanning the HB 67 in a width 

10 direction and computing the projections. Further, the 

width detectioh can be determined in accordance with the 
number of the scanning lines. 

Further, as shown in Fig. lOB, when the double bars 
68, 69 are marked, the second one 69 can be shorter 

15 than the first, thereby facilitating the marking and the 
detection. Further, multiplexed designations are 
possible as shown in Figs. 12A and 12B. Fig. 12A shows 
the combination of three different modes. The VB 71 
represents the character— read area, the long and short 

20 horizontal bars 72 and 73 represent the image output 
area and the single horizontal bar 74 represents the 
skip area. Figs. 12C through 12H show various modifi- 
cations representing the combinations of the two modes 
in the multiplexed designations in Fig. 12A. In 

25 Figs. 12C through 12H, "READ" stands for character-read 
area, "SKIP" stands for skip area and "IMAGE" stands for 
image output area. 

Fig. 12B shows an example of combining two modes, 
that is image output mode and skip mode. The number of 

30 areas in a horizontal direction is not limited to three. 
When the character-read data and the image-output data 
to be stored exceed the capacity of the image buffer, a 
sheet buffer provided in the memory 52 can be used for a 
substitute. 

35 Further, the vertical and horizontal bars in the 

above embodiments can be substituted for marks similar 
to the VB, HB or symbols. 
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Although only one exemplary embodiment of this 
invention has been described in detail above, those 
skilled in the art will readily appreciate that many 
embodiments are possible in the exemplary embodiment 
5 without materially departing from the novelty teachings 
and advantages of this invention. 

Accordingly, all such modifications are intended 
to be included within the scope of this invention as 
defined in the following claims. 
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Claims: 

1. A character and image processing apparatus 
having a scanning section (9) for scanning a sheet (1) 
and for photoelectrically converting the scanned data; . 
storage means (10) for storing the photoelectrically 
converted data; character recognizing means (12) and 
image data processing means (13r 14) characterized in 
that these are further provided with control mark means 
(4, 5, 6r 7r 8) for designating data areas to be 
processed cessed on a sheet (1) ; and 

control means (11) for scanning the stored data in 
said storage means (10) to detect said control mark 
means (4r -5, 6, 1, 8) and for determining a character 
read mode or an image data output mode according to said 
control mark means (4, 5r 6r "7, 8) so that said 
character recognizing iaeans (12) recognizes characters 
from said storage means (10) when said control means 
(11) determines said control mark means (4, 5> 6, 7, 8) 
as the character read mode and said image data processing 
means (13, 14) processes image data froin said storage 
means (10) when said control means (11) determines said 
control mark means (4, 5^ 6, 7, 8) as the image output 
mode • 

2. A character and image processing apparatus 
according to claim 1, wherein said control mark means 
(4, 5r 7, 8) is one or more vertical bars (4^ 5^ 

6) marked or printed in an empty area of the sheet (1) 
in a perpendicular direction to the character lines (2) 
and said control means (11) controls the switching of 
the character read mode and the image data output mode 
in accordance with the number and position of the bars 
(4, 5r 6). 

3. A character and image processing apparatus 
according to claim 2, wherein a whole area at right side 
of the sheet corresponding to the vertical bar or bars 
detected by said control means (11) is treated as a 
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Character-read area or an image data output area, 

4. A character and image processing apparatus 
according to claim 1, wherein said control mark means 
(4, 5r 6r 7r 8) are one or more vertical bars (4, 5) 
marked or printed in an empty area of the sheet in a 
perpendicular direction to the character lines and one 
or more horizontal bars (7, 8) marked or printed 

in a horizontal direction to the character lines and 
said control means (11) controls the switching of the 
character read mode and the image data output mode 
in accordance with the numbers and positions of the 
vertical and the horizontal bars (4, 5, 7, 8). 

5. A character and image processing apparatus 
according to claim i, wherein a two-dimensionally 
limited area at a right side of the sheet corresponding 
to the vertical bar (4) or bars (5) and the horizontal 
bar or bars detected by said control means (11) is 
treated as a character-read area or an image data output 
area • 

6. A character and image processing apparatus 
according to claim 1, wherein said control mark means 
(4r 5, 6, 7, 8) is a timing mark (16) in an empty area 
of the sheet and said control means (11) controls the 
switching of the character read mode and the image data 
output mode in accordance with the detection of the 
timing mark (16) . 

?• A character and image processing apparatus 
according to claim 6, wherein one of the character-read 
mode or the image data output mode is determined by said 
control means (11) upon detecting the upper edge of. the 
sheet (1) and thereafter in response to each detection 
of the timing mark (16), said control means (11) al- 
ternatively switches the character read mode and the 
image data output mode. 

8. A character and image processing apparatus 
according to claim 1, wherein said control means (11) 
further determines a skip mode according to the control 
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mark means (4^ 5/ 6, 7, 8), in which the character 
data and/or the image data are not processed by said 
character recognizing means and/or said image data 
processing means. 

9. A character and image data processing appa- 
ratus, according to claim 1, wherein said control means 
(11) further determines a completion of processing for 
the sheet according to said control mark means (4r 5, 6, 

10 • A character and image processing apparatus, 
according to claim 4, wherein said control means (11) 
. further determines a skip mode according to the control 
mark means (4, 5,6, 7, 8) and when the character data 
and the image data are mixedly arranged in the same 
lines, the character read area (READ), the image data 
output area (IMAGE) and/or the skip area (SKIP) and 
their combination are specified in a multiplexed form by 
the vertical and the horizontal bars. (71/ 72, 73, 74). 
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